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Evolution of Procedures 
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Early ISS— PDF 


Current ISS— IPV/XML 


Deep Space Exploration- AR 
• PRL Extension 


Orion; Enhanced XML (PRL) 

• Computer Oversight 

• Automation 


XT A . • Machine Vision and Marker-less Registration 

No Automation or Computer ° 

Oversight 
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Background 


# 


Mission Operations: Overview 

- Crew operate equipment using procedures 

- Mission Control staff operate equipment 
remotely using procedures 

- Mission Control staff maintain operations 
schedules and plans 

- Staffing, equipment configuration and 
manifests also require scheduling and 
planning 


Hardware 




Schedule 


Plan 
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Procedures contain knowledge 
about how to operate systems to 
achieve mission goals 

Procedures are the approved 
means by which a user operates 
a system 

Users of procedures include 
crew, flight controllers, 
instructors, mission designers, 
payload community, etc. 


Flight Procedure 
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Procedure Requirements 


• Need support for automating procedure execution 

- Commands and telemetry 

- Safety conditions/context 

- Explicit control structures 

• Don’t want to lose human readability 

- Capturing “look-and-feel” of current procedures 

- Presentation of procedure content in a human-friendly way 

• Improve quality of execution 

- Improved ease of use 

- Reduction of human error 

- Improved situational awareness 

• Interleave human actions with spacecraft scripts 

• Use Procedure Representation Language 

- Capture and formalized the above stated requirements 

- Started from NASA ODF standards and construct support automation 
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Procedure Representation 
Language (PRL) file 


Uses of PRL 
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Procedure Lifecycle Development 


• Procedure Authoring Tool (PAT) 

- Procedure authors currently use IPV (Licensed 
software & not easy to use) 

- Need an easy-to-use authoring environment 

- Need an easy method to add telemetry & 
commands 

• Procedure verification & validation (PV) 

- Procedure verifiers are human intensive 

- Need for desktop verification tools to catch simple 
mistakes 

• Procedure Library Admin. (PLA) 

- Configuration control works reasonably well 
today 

- Need to be integrated with Procedure Repository 
and Procedure approval system 

• Procedure Viewer/Executor (PVE) 

- Integration with crew time and Caution & 

Warning system 

- Need to view/execute/track anywhere and any 
configuration (stationary, mobile, hand-free. Etc.) 

• Procedure training 

- Integration with Workflow CR and procedure 
verification and validation 

- Measure and track performance 



Measurement 

Performance 
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System Representation 


• Procedure language describes how to operate any system. They do 
not describe the system itself 

• System representation needs to define 

- Telemetry 

- Commands and command parameters 

- System hierarchy and classes 

• e.g., commanding the Orion Display Pages 

• Must be available during procedure editing, validation and 
execution 

• We selected XML Telemetric & Command Exchange (XTCE) — 
an industry and NASA standard 
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PrIDE 


File Edit View Search Run Window Help 
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Procedure Authoring Tool 
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1. Lighting 1 
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Procedure Viewer & Executor 



TOC A. Buffer Changeout Pro c. 

Siigj 1 - Cover Htmoval 


Siep 3 ■ nutter Removal 
Sie*i 4 - Bulier HejUacemern 


WARNIN'' Remove lid of 
container slowly, as 
contents are under 
pressure and cou!d burst! 


Google Glass - Focus on Mobility & 
mobile interactions 


AR-eProc- Focus on mixed reality interaction 


Capture Rich Procedure Content Once and Use It Everywhere! 1 
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Johnson space center SEATEST II: Tust-in-time training & procedure execution 

Engineering Directorate J ° A 

Software, Robotics and Simulation Division with Glass 


Miniature Exercise Device (MED): 

a. Equipment Assembly Task 

b. Equipment Dis- Assembly Task 



Just-in-time (JIT) training of a Sani-tank 
purge 

After the task was completed using the 
Google Glass - the same JITT material was 
viewed on an iPad 
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Augmented Reality Training Assistance 




Autonomous 

Operation 


The AR-eProc 
Vision 


AR ARED - Augmented reality 
Advanced Resistive Exercise 
Device Cylinder Evac. Procedure 


AR DSH Locator - Deep Space 
Hab augmented reality assets 
monitoring 


AR Ultrasound - 

Autonomous 

guidance 


AR TOCA - Augmented reality 
Total Organic Carbon Analyzer 
Buffer Change Out Procedure 








